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ABSTRACT 

A process evaluation was conducted to determine the 
status of the School District of the City of Saginaw's Adult Basic 
Education (ABE) program operations during 1991-92. The instrument 
focused on nine aspects of an ABE classroom: start of class; time 
spent in instruction (for three subject areas and total) ; modes of 
instruction; extent of individualized instruction; materials used; 
frequency and nature of feedback; disruptive behavior; classroom 
formality; and testing occurrence/procedures. Findings were based on 
observations of 23 classrooms. In most sites, classes began on time 
and the teacher was present before it started. Each classroom tended 
to offer instruction in reading and mathematics during each class 
session and to devote the most class time to reading. Instructors 
used more than one instructional method and used checking for 
understanding as a teaching device in the majority of lessons. 
Individualized instruction was also widely seen in each subject area. 
The large majority of reading and mathematics instruction was 
conducted using books/workbooks on the booklist. Positive feedback 
was in evidence in all sites; negative feedback was seen at only 
eight sites. Disruptive behavior was not frequently seen, minor in 
nature, and handled appropriately by the teacher. Class formality 
approximated the supervisor's intention. Testing was observed in 12 
sites — in half, proper procedures were not used. In general, the 
program was operating as planned, but improvements in the areas of 
mathematics and Michigan Life Role Competencies instruction and 
testing were recommended. (The observation sheet with compiled 
results is appended.) (YLB) 
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INTRODUCTION 



The School District of the City of Saginaw's Adult Basic Education (ABE) 
program is designed to provide educational services to adults who have less 
than an eighth grade education. These services included basic and remedial 
instruction in communication and computation skills, Michigan life role com- 
petencies (MLRC), English as a second language (ESL), adult bilingual, and 
pre-general educational development (Pre-GED) . The 1991-92 school year is the 
program's thirty-first consecutive year of operation. 

The ABE program serves a diverse population of adult with program goals 
and objectives designed to meet their educational needs. Among these adult 
learners are the following: those residing in urban, high unemployment areas; 
members of minority groups; those residing in rural areas; limited English 
speaking; elderly; handicapped; immigrant; institutionalized; and women with 
special needs. 

Enrollment in ABE is open throughout the year. Upon enrolling, each 
student's needs are identified. An individualized educational plan (IEP), 
which focuses on those needs and establishes educational objectives for that 
student, is drawn up. The teacher to whom that student is assigned writes 
that plan with the student. 

During this year, 1,056 adult learners received services. They attended 
one or more of the 40 classes conducted at the 15 centers located throughout 
Saginaw. The sites are listed in Appendix A. These classes were designed to 
be taught in a traditional manner wherein three instructional topics (reading, 
mathematics, and MLRC) were to be taught on a daily basis and the entire class 
would be working on assignments within the same topic at the same tim*-. 
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The ABE staff consisted of 35 people. It included one program super- 
visor, 17 full-time and seven part-time teachers, three full-time and three 
part-time teacher aides, one full-time student-advisor, one full-time and one 
part-time secretary, and one part-time parent resource specialist. In 
addition, there were 54 volunteer literacy tutors. 

A process evaluation consisting of classroom observations was conducted 
to determine the status of program operations. This description of the 
program status will be the focus of the report. 



PROCEDURES 

The purpose of a process evaluation is to determine whether a program is 
being implemented as planned and/or if there are any problems in its opera- 
tion. This year, as in previous years, the process evaluation consisted of 
on-site classroom observations. 

Beginning March 17, 1992 and continuing through April 30, 1992, two 
evaluators conducted on-site observations of ABE classrooms. Each observation 
lasted the entire length of the class session. 

The instrument used to record these observations (see Appendix B) is a 
revised version of the instrument used in previous process evaluations. The 
instrument, and the observations, focused upon the following nine aspects of 
an ABE classroom: the start of the class; the time spent on each subject area 
(reading, mathematics, and MLRC) and total; the modes of instruction; the 
extent of individualized instruction; the types of materials used; the 
frequency and nature of feedback; the frequency of and reaction to disruptive 
behavior; the degree of formality in the classroom; and testiag occurrence 
and procedures. 

It should be noted that, prior to the start of these observations, the 
ABE instructors were informed, by the program supervisor, that the observa- 
tions would be beginning and that their intent was to evaluate the program as 
a whole and not individual instructors. 

The data presented in the following section were taken directly from the 
completed observation instruments. 
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RESULTS 

The following is a presentation of the findings from the on-site obser- 
vations of 23 ABE classrooms. These findings are summarized under headings 
corresponding to the nine aspects of ABE classrooms addressed by the obser- 
vation instrument. The entire tabulated results of the 1991-92 observations 
can be found in Appendix B. 

Start Of Each Class 

There were four class start-up concerns: was each class started on time; 
was the classroom teacher present at least five minutes prior to the class 
starting; was attendance taken via a sign-in sheet; and was a preview of class 
activities presented. Table 1, below, presents the findings as to these 
e lement s . 



TABLE 1. NUMBER AND PERCENT OF ABE CLASSROOMS BY OCCURRENCE 
OF CLASS START ELEMENTS, 1991-92. 



Elements 



Occurred? 

Yes No Total 

HZ N Z N I 



Class began on time 19 82.6 4 17.4 23 100.0 

Teacher was present 22 95.7 1 4.3 23 100.0 

at least five minutes 
before class began 

Attendance was taken 22 95.7 1 4.3 23 100.0 

via sign-in sheet 

A preview was given 22 95.7 1 4.3 23 100. 0 



A review of Table 1 reveals the following points: 

• In 19 (82.6°0 of the observed sites, the classes 
began on time and in all but one case (95,7%) the 
teacher was present before it started. 

• In 22 (95.7%) of the observed sites, attendance was 
taken via a sign-in sheet. Anecdotal evidence 
indicates that attendance was recorded by the teacher 
in one class (4.3%) . 

• In 22 (95.7%) of the sites, a general preview of 
class activities was offered. 



Time Spent In Instruction, By Subject Area And Total 

Three areas which were to be taught on a daily basis in the ABE classes: 
reading, mathematics, and MLRC. Table 2, below, presents the number and 
percent of sites observed offering instruction, by topic. 

TABLE 2. INSTRUCTION OFFERED IN ABE CLASSROOMS, 
BY INSTRUCTIONAL TOPIC, 1991-92. 



Instruction Offered? 

Topic 

Yes No Total 





N 


% 


N 


% 




N* 


Z 


Reading 


23 


100.0 


0 


0.0 


23 


100 


.0 


Mathematics 


20 


95.2 


I 


4.8 


21 


100 


.0 


MLRC 


7 


33.3 


14 


66.7 


21 


100 


.0 



*Two classes (ESL and Bilingual), by definit ion, did not offer 
mathematics or MLRC instruction. 



An examination of Table 2 indicates that reading instruction was offered 
in all (100.0%) of the sessions. Mathematics and MLRC instruction were 
observed in oi; .2% and 33.3%* of the sessions, respectively. 



This represents a substantial increase in the number of sites offering 
math instruction, up from 78.9% in 1990-91, but a substantial decrease in the 
number offering MLRC instruction, down from 68.9% in 1990-91. 



Across classrooms, the time devoted to each of these topics was to be 

approximately equal (excepting the ESL and bilingual classes, where the focus 

was on English use) with reading instructio: allotted the most class time, 

mathematics the second most, and MLRC the respective least. Table 3 below, 

presents the mean instructional time allotted each topic in all ABE 

2 

classrooms. (Appendix C contains these data for standard ABE classrooms.) 

Prior to examining Table 3, it should be noted that, per the supervisor's 
request, time spent viewing "Channel One 11 was excluded for instructional time. 

TABLE 3. AMOUNT OF INSTRUCTION OFFERED IN ABE CLASSROOMS 
(N=23), BY INSTRUCTIONAL TOPIC, 1991-92. 



Instructional Tiwe 
Topic In Minutes* 

Mean Standard Deviation 



Reading/Language Arts 


100. 


7 


28.6 


Mathemat ics 


29. 


.9 


15.8 


MLRC 


8. 


.2 


12.9 



^Readers are reminded that these statistics were calculated 
using all observed classes, some of which did not have in- 
s true tion in all topics. 



From Table 3, it can be seen that in those classes where the instruction 
was offered, reading instruction accounted for the most minutes, mathematics 
the second most, and MLRC the least. (This relative emphasis was also found 
across the standard ABE classes, although the average time spent per topic and 
the variance between teachers was less, see Appendix C.) 



Standard ABE classrooms were those designed to offer reading, mathematics 
and MLRC instruction in a three hour block. Classes where the focus is more 
directed on one of these topics (i.e., ESL or bilingual) or where the class 
length is different (i.e., teen mother, senior citizen, handicapped, and 
incarcerated students) were excluded from Table C.l. 
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In interpreting Tables 2 and 3 (and CI), it is important to note the 
intention of the program supervisor. In conversation with the evaluator, the 
supervisor indicated that all ABE classrooms were expected to offer all three 
topics during each class sessiou, devoting approximately the same proportion 
of time to the respective topics as was seen in Table 3. 

The evidence from the tables suggests that this intention is not fully 
realized • 

• Wh i le read ing ins true tion occurred in all of the 
sessions, inst ruction in mathemat ics and MLRC did not . 

• While the amount of time devoted to instruction per 
top ic is cons istent with the supervisor's intentions, 
the standard deviations indicate that there is still 
a large amount of var iance between ins true tors in the 
amount of per topic instruction offered. (An examination 
of Table CI suggests that variance is not solely due 

to differences in the nature of the classes. ) 

The final aspect of interest in this regard was the total amount of 

instructional time. Scheduled length of instruction was 165 minutes per 

ssession in nineteen ($2.6%) sites and slightly less in the other four (17.4%) 

sites. The mean length of observed instruction was 143.7 minutes (standard 

4 

deviation was 19.5), and the observed times ranged from 87 to 152 minutes. 

Serial Order Of Topics 

It was the supervisor's preference that the instructional topics be 
presented in the order: reading/language arts, mathematics, and MLRC. An 
examination of the s tar ting and end ing times of topic presentation within each 
class revealed the following. 



i.e., ESL versus standard ABE classes. 

The observed figures do not include class time spent viewing Channel One. 



• Reading/ language arts was presented first in 21 (91.3%) 
cases, second in one (4.7%) case, and third in the 
other (4.7%). 

• In the 20 cases where mathematics instruction was 
offered it occurred second in 16 (80.0%) sites, 
first twice (10.0%), and third twice (10.0%). 

• MLRC was the third topic in seven (70.0%) of the 10 

c lasses where it was of f ered , and the second topic in 
the other three (30.0%) ♦ 

• In three classes (13.0%), topics were presented con- 
current ly • 

The Modes of Instruction 

There were eleven modes of instruction specified on the observation 
instrument: modeling, guided practice/monitoring, checking for understanding, 
drill, lecture, problem solving, group discussion, review/follow-up, reading 
aloud, exercises on the chalkboard, and television. In Table 4, below, 
presents the ABE instructors' of the use of these methods, by topic. 

TABLE 4. FREQUENCY OF USE OF MODES Ok INSTRUCTION, BY INSTRUCTIONAL 
TOPIC, IN ABE CLASSR*X?iS, 1991-92. 



Topic 

Modes of 

Instruction Reading Mathematics MLRC 

(N=23)* (N=20) (N=7) 





N 




N 


Z 


N 




I 


Mode ling 


19 


82.6 


14 


70.0 


0 


0 


.0 


Guided Practice/ 
















Monitoring 


21 


91.3 


13 


65.0 


1 


14 


• 3 


Checking for 
















Understanding 


22 


95.6 


16 


80.0 


4 


57 


.1 


Drill 


7 


30.4 


2 


10.0 


0 


0 


.0 


Lecture 


4 


17.4 


4 


20.0 


4 


57 


.1 


Problem Solving 


4 


17.4 


4 


20.0 


0 


0 


.0 


Group Discussion 


13 


56.5 


0 


0.0 


5 


71 


.4 


Re view/Fol low-Up 


12 


52.2 


3 


15.0 


2 


28 


.6 


Reading Aloud 


6 


26.1 


0 


0.0 


1 


14 


.3 


Chalkboard Exercises 


7 


30.4 


2 


10.0 


0 


0 


.0 


Recitation 


2 


8.6 


0 


0.0 


0 


0 


.0 
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*Number of sites In which instruction in the relevant topic occ/arred. 
**Percents sum to more than 100; instructors used multiple methods. 
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A review of Table 4 suggests the following. 

• Instructors are using multiple modes of instruction* 

i 

• For reading instruction, checking for understanding, 
guided practice, and mode ling were the most frequent ly 
used. Group discussion and review/follow-up were 
used in over half of the classrooms. All of the other 
listed modes were used in at least two classes. 

• In mathematics instruction, checking for understanding 
was the most frequently used mode. Modeling and guided 
practice were seen in half of the sites. Other modes 
were used infrequently (in less than 25% of the sites), 
if at all. 

• Group discussion was the preferred modes of MLRC instruc- 
tion. Checking for understanding and lecture were used 
in more than half the sites. 

Related to the modes of instruction was whether the instructor offered 
previews for, checked for students' understanding of, and offered a closure on 
lessons. Table 5, below, shows the occurrence of these variables in ABE 
classrooms, by instructional site. 

TABLE 5. NUMBER AND PERCENT OF ABE CLASSROOMS WHERE INSTRUCTIONAL 
VARIABLES WERE OBSERVED, BY INSTRUCTIONAL TOPIC, 1991-92. 



Instructional Variables 

Topic Preview Checking Closure 

Understanding 





N 


I 


N 


Z 


N 


Z 


Reading (N=23)* 


16 


69.6 


18 


78.3 


7 


30.4 


Mathematics (N=20) 


8 


40.0 


12 


60.0 


1 


5.0 


MLRC (N=7) 


0 


0.0 


1 


14.3 


1 


14.3 



*Nurnber of sites in which instructive in the relevant topic occurred* 



By examining Table 5, one can see the following. 



• In both reading and mathematics instruction, checking 
for understanding was more evident (observed in 78.3% 
and 60.0% of the sites, respectively) than was providing 
a preview (69.6% and 40.0%, respectively). However, 
previews were more evident than closures (30.4 and 5.0%, 
respective ly ) . 

• In MLRC instruction, no previews were observed and check- 
ing for understanding and closure were observed only once 
(14.3%, each). 



Individualized Instruction 

The extent to which instruction was individualized was also examined. 
Table 6, below, presents the number and percent of observed sites where 
individualized instruction occurred, either on a one-to-one or a small group 
basis, by instructional topic. 



TABLE 6* EXTENT AMD NATURE OF INDIVIDUALIZED INSTRUCTION OFFERED 
IN ABE CLASSROOMS, BY INSTRUCTIONAL TOPIC, 1991-92. 



Topic 



Individualized Instruction 



One -on -One 
N Z 



Small Group 
N Z 



Both 
N Z 



Whole 
Class* 
N Z 



Reading (N=23)** 5 21.8 

Mathematics (N=20) 12 60.0 
MLRC (N=7) 1 14.3 



2 8.7 
2 10.0 
2 28.6 



15 65.2 
5 25.0 
1 14.3 



1 4.3 
1 5.0 
3 42.9 



^Instruction was addressed to all students simultaneously. 
**Number of sites in which instruction in the relevant topic occurred; 
row percents (which may not sum to 100.0% due to rounding) are 
based upon that number. 



ERLC 



10 



f V 

10 



From examining Table 6, the following can be seen about individualized 
instruction* 

• In reading instruction, it occurred in 22 (95.7%) of 
the sessions* In most (15; 65.2%) cases, both forms 
(one-to-one and small group bases) were seen. 

• In mathematics instruction, it occurred in 19 (95.0%) 
sessions and it was mostly on a one-to-one basis (12 
sites; 60.0%). 

• In MLRC instruction, it occurred in 4 (57.1%) sessions 
and was mostly on a small group basis. 

Types of Materials 

Another element of interest was whether the textbooks and/or workbooks 

used were on the ABE book list. Table 7, below, shows the number and percent 

of classrooms using materials from the book list during instruction, by topic. 

TABLE 7. NUMBER AND PERCENT OF ABE CLASSROOMS USING BOOKS LISTED ON 
THE ABE BOOK. LIST, BY INSTRUCT IONAL TOPIC, 1991-92. 



On ABE Book List? 

Topic Yes No 

N Z N Z 



Reading (N=23)* 22 95.7 1 4.3 

Mathematics (N=20) 18 90.0 2 10.0 

MLRC (N»7) 4 57.1 3 42.9 



-Number of sites in which instruction in the relevant topic occurred. 

From viewing Table 7, it can be seen that the majority (57.1% - 95.7%) of 
observed ABE classrooms used books or materials on the ABE book list. 



Frequency and Nature of Feedback 

Providing students with effective and appropriate feedback is an impor- 
tant element of ABE classes. Within each observation, during a specified 
period of time (lasting ten minutes), the frequency of positive and negative 
feedback was recorded. Also recorded was the evaluator's assessment of 
whether the feedback was effective and appropriate* 

Pos i t i ve comments were observed in all sites, with an average frequency 
of 12.0 (standard deviation = 6.0). Negative comments were observed in eight 
(34.8%) sites with an average frequency of 1.6 (standard deviation = 1.3). 
In general, positive and negative feedback were found to be both appropriate 
and effective and negative feedback was followed by statements of expected 
behavior • 

Frequency of and Reaction to Disruptive Behavior 

A question which was related to feedback was whether any disruptive 
behavior occurred. Disruptive behavior was seen in only six sites (26.1%) 
during 1991-92, and that in all cases the disruptions were minor in nature and 
limited to one or a few students. Teacher responses to these disruptions were 
considered appropriate in five (83.3%) of these cases. 

Extent of Class Formality 

The degree of class f ormali ty was measured in two ways : the mode by 
which the teacher and students addressed each other and the way in which 
guided practice was conducted (Whether the student needed to approach the 
teacher before obtaining assistance). Also examined was whether this level of 
class formality reflected student preference. 
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It was found that teachers addressed students by their first names in 21 
(91.3%) sites; in the other t^o sites (8.7%) both first names and last names 
with a title (Mr., Mrs., etc.) were used. Correspondingly, it was found that 
students addressed teachers by their first names in 9 (39.1%) of the sites, by 
their last names with a title in 13 (56.5%) of the sites, and in one (4.3%) 
site, both addresses were heard. 

Guided practice was conducted at the student's desk (or seat) in all 23 
(100.0%) of the sites. Similarly, questions about the student's work were 
most often initiated by the teacher in all 23 (100.0%) sites. The degree of 
formality was found to be, in general, what the students preferred in 22 
(95.7%) of the classes; in one site (4.3%), student preference with regard to 
foramality was not an issue. 

Testing Occurrence and Procedures 

During 12 of the 23 observations (52.2%), testing was occurred. Table 8, 
below, summarizes the major findings regarding testing procedures within these 
six observations. 
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TABLE 8. NUMBER AND PERCENT OF ABE CLASSROOMS (3=12), 
BY OCCURRENCE OF TESTING VARIABLES, 1991-92. 



Occurred? 

Testing 

Variable Yes No Total 

N Z N Z N Z 



Student Behavior 

All students 

took test 4 33 . 3 8 66.7 12 100.0 
Non-test takers 

separated 3 37.5 5 62.5 8* 100.0 
Non-test takers 

talking 3 37.5 5 62.5 8* 100.0 
Test takers 

talking 5 41.7 7 58.3 12 100.0 
Books and papers 

put away 11 91.7 1 8.3 12 100.0 
Teacher Behavior 

Teacher provided oral 
instructions prior 

to the test 6 50.0 6 50.0 12 100.0 
Teacher distributed 

the test 9 75.0 3 25.0** 12 100.0 
Teacher collected 

the test 9 75.0 3 25.0** 12 100.0 
Teacher corrected 

the test 10 83.3 2 16.7** 12 100.0 
Teacher recorded 

the score 4 33.3 8 66.7 12 100.0 
Teacher gave 
inappropriate 

assistance 1 8.3** 11 91.7 12 100.0 



*The numbers and percents of these rows are based only upon the eight 
testing instances when some members of the class were not among the 
test takers. 



**These activities were performed by an aide. 



An examination of Table 8 indicates that not all of the expected testing 
procedures were observed in all sites. In six (50.0%) cases did the teacher 
(or an aide) offer verbal instructions prior to the test and in one case 
(8.3%) an aide offered inappropriate assistance to a tes t taker. In five 
cases (41.7%) test takers were talking; and in the eight cases where there 
were non-takers, three (37.5%) cases of non-taker talking were observed. 

However, in all (100.0%) cases, either a teacher or an aide distributed, 
collected, and corrected the tests; in four (33.3%) cases , the scores were 
recorded in the teacher's grade book, in the remainder (8; 66.7%), grades were 
not recorded during class. 

Last, the content areas of the tests were: mathematics (6; 50.0%), 
spelling and language arts (5; 41.7%, each), self concept (an MLRC objective 
[1; 8.3%]), and oral presentation skills (1; 8.3%). In four cases (33.3%), 
students took more than one test. 

Additional Comments 

The following is a summary of comments which either expanded upon what 
the evaluator observed or provided pertinent details which were not addressed 
by the observation instrument. 

• In three (13.0%) cases, the amount of instructional 
time was limited by external constraints - 
assemblies (2; 8.7%) and institutional reasons (1; 
4.3%). In one case (4.3%), the teacher focused on 
an extraneous topic for a substantial portion of 
the class (65 minutes; 39.4% of the available 
instructional time) . 

• In one class (4.3%) erronous material was presented 
and in one othci (4.3%) class discussion wandered 
from curricular to colloquial topics. 
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• In two instances (8.7%), good interaction between 
the teacher and the students (in a curricular 
context) was noted . 

• Three teachers (13,0%) explained to the evaluator 
why MLRC instruction was not in evidence on the day 
of the observation. Students had completed the 
lessons in those MLRC materials which the teachers 
had thus far received; they were awaiting the new 
MLRC materials . 
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SUMMARY 



This was the 31st consecutive year the School District of the City of 
Saginaw has operated an Adult Basic Education (ABE) program. This program 
served a diverse population of adults (all of whom had a less than eighth 
grade educat ion) by us ing and objectives speci f ical ly des igned to meet the ir 
educational needs. During this year, 747 adult learners received services by 
attending one or more of the 41 classes conducted at the 15 centers located 
throughout Saginaw. 

A process evaluation was conducted to determine the status of program 
operations during 1991-92 and consisted of on-site, classroom observations. 
The observation instrument focused on nine aspects of an ABE classroom: start 
of the class; time spent on each subject area (reading, mathematics, and MLRC) 
and total; modes of instruction; extent of individualized instruction; 
materials used; feedback; disruptive behavior; classroom formality; and 
testing occurrence/procedures. 

The findings from these observations included the following points. 

• In most (82.6%) sites, classes began on time and 
the teacher was present before it started almost 
every time (95.7%). Attendance taken using a 
sign-in sheet and previews of class activities 
were also widely evident (95.7% of the sites each, 
respectively) . 

• Somewhat consistent with the supervisor's inten- 
tion, there is a tendency toward each classroom 
offering ins true t ion in reading and ma thema t ics 
during each class session and toward devoting 
the most class time to reading (then mathematics, 
then MLRC; presented in that serial order). 
However, the percent (66.7%) of classes wherein 
MLRC instruction was not seen and the variation 
in the time spent per topic indicate this inten- 
tion has not been fully realized. 
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• ABE instructors used more than one instructional 
method. In reading, the most frequently used 
methods were mode ling , guided pract ice , and 
checking for understanding; in mathematics, the 
most frequently used was checking for understand- 
ing; and in MLRC, group discussion was favored. 

• In the majority of lessons, ABE instructors used 
checki ng for under s tanding as a teaching device ; 
previews were not as frequently used as checking 
and closure was observed in less than one third 
of the lessons. 

• Individualized instruction was also widely seen in 
each subject area. In mathematics, it tended to 
be in one-on-one form; in MLRC, it tended to be 

in small group form; in reading, both forms were 
used frequently. 

• The large majority of reading and mathematics 
instruction (95.7% and 90.0%, respectively) was 
conducted using books/workbooks on the ABE book- 
list. A smaller majority of the MLRC instruction 
(57.1%) used materials on that list. 

• Positive feedback was in evidence in all of the 
sites and negative feedback was seen at only eight 
(34.8%) sites. Feedback was effectively and appro- 
priately used. 

• Disruptive behaviour was not frequently seen (in 
only six [26.1%] sites); it was minor in nature, 
limited to a few students and (generally - in five 
[83.3%] cases), handled appropriately by the 
teacher. 

• Clas s formality approximates the supervi sor ' s 
intention. Teachers, in general, referred to 
students by their first names while students 
varied (at some [9; 39.1%] sits by first names, 
at others [13; 56.5%] by a last name and title, 
and at one site [4«3%] both were heard). Teachers 
took the initiative to verify student understand- 
ing of the lesson and individualized instruction 
occurred at the students' desks. 




« Testing was observed in 12 (52.2%) of the sites. 
In half (6; 50.0%) of these sites, proper proce- 
dures were not used. Mostly, the deviancies were 
minor: test takers and non test takers talking 
and papers and books not being put away; Yet in 
one instance (8.3%), an aide offered inappropriate 
assistance. 

In general , the ABE program is operating as planned * However, areas 
remain where improvement should be sought. In the following section, some 
recommendations toward that end are offered. 
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RECOHMENDAT IONS 



Prior to offering recommendations, it should be reiterated that the 
program is, overall, attaining its goals* These recommendations, which are 
based upon the results presented above and conversations with the program's 
supervisor and staff, are presented with the aim of enhancing an already 
effective program* 

It should also be noted that the recommendations below are not meant to 
be exhaustive; the enhancements they suggest may be attainable through other 
means. The supervisor and staff may want to consider what other means are 
available and should seek assistance from the Department of Evaluation, 
Testing, and Research* 

• Each ABE instructor offered some reading instruc- 
tion, however, mathematics and MLRC instruction 
were not consistently seen. Further, the varia- 
tion between instructors in the time spent on 
each topic was large. It appears that the pro- 
gram supervisor's instructional aims are not 
being fully met. Since this is an important 
consideration, the program supervisor should pro- 
vide clinical supervision to those ABE instructors 
whose instructional plans and/or activities differ 
from this aim: 

- Examine lesson plans and conduct suffic- 
ient classroom observations to determine 
which instructors are not attaining this 
instructional aim; 

- In form them that instruction in each of 
the topics is to be offered in each class 
session and of the approximate amounts of 
class time should be devoted to each topic; 
and 

- Determine if there is some need (s uch as 
materials, inservice training, etc.) which 
is hindering these instructors from this 
providing instruction and if there is some 
way the program can meet this need. 
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- Similarly, if a need is identified but 
can not be met in a timely fashion by 
program supervisor/staff (recall three 
teachers which indicated that waiting 
for new MLRC materials), the supervisor/ 
staff should consider alternate ways to 
meet the need during the interim (e.g., 
use of MLRC materials from previous 
years) • 

• Since not all of the expected testing procedures were 
observed each t ime a test was given, the supervisor/ 
staff should review these procedures. Further, since 
aides were helping to administer these tests, the 
aides should participate in the review. 

• Cons i deration should be given to seeking input from 
ABE teachers as part of the process review. 
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APPENDIX A. 



ADULT BASIC EDUCATION CENTERS 1991-92 



Center Mane 

Arthur Eddy Mental Health Center 
Bethel A.M.E. Church 
Coulter Elementary Schoo 1 
Elmwood Manor 

First Ward Community Center 

Grace Presbyterian Church 

Holy Rosary 

Marie Davis Center 

Neighborhood House 

Redeemer Lutheran Church 

Ruben Daniels Lifelong Learning Center 

Saginaw Valley Rehabilitation Center 

Saginaw County Jail 

SER: Jobs For Progress 

Trinity Center 



Street Address 

1000 Cathay 

535 Cathay 

1450 Bridgton 

2814 E. Genesee 

1410 N. 12th 

600 Dearborn 

820 S. 20th 

222 S. Weadock 

3145 Russell 

3829 Lamson 

115 W # Genesee 

919 Veterans' Memorial Pkwy 

208 S. Harrison 

1535 S. Warren 

346 S. 9th 
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1991-92 ABE OBSERVATION SUET 
(N=23) 



Date: 

Time Class Began: 



Evaluator : Teacher : 



Location: Ruben Daniels Life Long 

Learning Center* (11; 47.8%) 

Other (cooperative 
agreement) sites (12; 52.2%) 



INSTE1JCTI0NS: Please circle or fill-in as appropriate. 

Class: ABE (21; 91.3%) ESL ( 1; 4.3%) BILINGUAL ( 1; 4.3%)** 

(Range) Number Enrolled: 6-23; Nunfcer Attending: 1-18; Attending: 10.0-100.0% 

I. THE START OF THE CLASS 

1. Did the class begin on time? YES (19; 82.6%) NO ( 4; 17.4%) 

2. Was the teacher in the room 

at least five minutes prior to its start? YES (22; 95.7%) NO ( 1 ; 4.3%) 

3. Was a sign-in sheet used to take attendance? YES (22; 95.7%) NO ( 1; 4.3%) 

4. Was the class given a preview of the day's 

activities and /or upcoming events... 

In oral form? 6 (26.1%) 

In written form? 5 (21.7%) 

In both forms? 11 (47.8%) 

No preview given. 1 ( 4.3%)** 



-'Program's home site 
**Sun to 99.9%, rounding. 
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II. SEADDG/LANGlIAGE ARTS (Observed in 23 sessions; 

percents in this section are based on those 23). 

1. Time (in minutes) spent on reading: X = 100.7 s.d. = 28.6%* 

2. Vhich of the following instructional materials were used? 

If Yes, what was the title? 

Textbooks and/or workbooks YES (22; 95.7%) NO ( 1; 4.3%) 

-"Language Exercises" (10) 

-"Challenger" (8) 

-"Laubach" (6) 

-"Focus On Phoentics" (2) 

-"World History And You" (2) 

-"3ide-By-Side" (2) 

-other (2) 



Films trip 


YES ( 0: 


0.0%) 


NO 


(23; 100.0%) 


Movie 


YES ( 0; 


0.0%) 


NO 


(23; 100.0%) 


Videotape 


YES ( 0; 


0.0%) 


NO 


(23; 100.0%) 


Computer assisted 












instruction 


YES ( 4; 


17.4%) 


NO 


(19; 


82.6%) 


Flashcards 


YES ( 3; 


13.0%) 


NO 


(20; 


87.0%) 


Newspapers 


YES ( 1 ; 


4.3%) 


NO 


(22; 


95.7%) 


Phonebook 


YES ( 1; 


4.3%) 


NO 


(22; 


95.7%) 


Which of the following modes of instruction were used? 








Modeling (examples given) 


YES (19; 


82.6%) 


NO 


( 4; 


17.4%) 


Guided practice 












(monitoring) 


YES (21; 


91.3%) 


NO 


( 2; 


8.7%) 


Checking for understanding 


YES (22; 


95.7%) 


NO 


( i; 


4.3%) 


Drill 


YES ( 7; 


30.4%) 


NO 


(16; 


69.6%) 


lecture 


YES ( 4; 


17.4%) 


NO 


(19; 


82.6%) 


Problem solving 


YES ( 3; 


13.0%) 


NO 


(20; 


87.0%) 


Group discussion 


YES (13; 


56.5%) 


NO 


(10; 


43.5%) 


Review/ f o llow-up 


YES (12; 


52.2%) 


NO 


(ii; 


47.8%) 


Reading aloud 


YES ( 6; 


26.1%) 


NO 


(17; 


73.9%) 


Exercises on chalkboard 


YES ( 7; 


30.4%) 


NO 


(16; 


69.6%) 


Please specify any other method seen 










Was the instruction individualized.. 












On a one^on^one basis? 


( 5; 21.7%) 








Ch a small group basis? 


( 2; 8.7%) 








On both bases 


(15; .3. 


2%) 








No individualized instruction seen 


( 1 ; 4.3%) 









*When classes not scheduled in a three hour block and/or designed for a specific course content 
(e.g., ESL) were excluded, the mean was 95.2 minutes (standard deviation = 23.3); both means 
and standard deviations, by the progran supervisor's request, exclude time viewing Channel One. 
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5. Which of the following were observed durinp reading instruction 

A preview of the lesson YES (16; 69.6%) NO ( 7; 30.4%) 
A check for students' 

prior knowledge YES (18; 78.3%) NO ( 5; 21.7%) 

Closure on the lesson YES ( 7; 30.4%) NO (16; 69.6%) 

6. Cbnments on the reading session: 



III. HKOEMATICS (Observed in 20 classroons; percents in items III 2-5 are based on these 20). 

1. Time (in minutes) spent on mathematics: X = 29.9 s.d. - 13.5* 

2. Which of the following instructional materials were used? 









If Yes, 


what was 


the title? 


Textbooks and /or workbooks 


YES 


(18; 


90.0%) 


NO ( 2; 


10.0%) 


-"Spectrun" (11) 












Filmstrip 


YES 


( 0; 


0.0%) 


NO (20; 


100.0%) 


Movie 


YES 


( 0; 


0.0%) 


NO (20; 


100.0%) 


Videotape 


YES 


( 0; 


0.0%) 


NO (20; 


100.0%) 


Computer assisted 












instruction 


YES 


( i; 


5.0%) 


NO (19; 


95.0%) 


Handouts 


YES 


( 6; 


30.0%) 


NO (14; 


70.0%) 


Poster 


YES 


( i; 


5.0%) 


NO (19; 


95.0%) 



3. Which of the following modes of instruction were used? 



Modeling (examples given) 


YES 


(14 


; 70.0%) 


NO 


( 6 


; 30.0%) 


Guided practice 














(monitoring) 


YES 


(13 


; 65.0%) 


NO 


( 7; 


35.0%) 


Checking for understanding 


YES 


(16: 


80.0%) 


NO 


( 4; 


20.0%) 


Drill 


YES 


( 2 


; 10.0%) 


NO 


(18 


; 90.0%) 


Lecture 


YES 


( 4; 


20.0%) 


NO 


(16; 


80.0%) 


Problem solving 


YES 


( 4 


; 20.0%) 


NO 


(16 


; 80.0%) 


Group discussion 


YES 


( 2; 


10.0%) 


NO 


(18« 


90.0%) 


Review/ f o 1 low-up 


YES 


( 3 


; 15.0%) 


NO 


(17 


; 85.0%) 


Reading aloud 


YES 


( 0; 


0.0%) 


NO 


(20 


1 100.0%) 


Exercises on chalkboard 


YES 


( 2 


; 10.0%) 


NO 


(18 


; 90.0%) 


Please specify any other method 


seen 













*Vhen classes not scheduled in a three hour block and /or designed for a specific course content 
(e.g., ESL) were excluded, the mean was 27.5 minutes (standard deviation = 17.1); both means 
and standard deviations, by the program supervisor's request, exclude any time spent watching 
Channel One. 
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4, was the instruction individualized... 

On a one-on-one basis? (12; 60.0%) 

Cn a small group basis? ( 2; 10.0%) 

Oh both bases ( 5; 25.0%) 

fb individualized instruction seen ( 1; 5.0%) 

5. Vhich of the following were observed during mathematics instruction? 



A preview of the lesson 
A check for students' 
prior knowledge 
Closure on the lesson 

6. Comments on the mathematics session: 



YES ( 8; 40.0%) NO (12; 60.0%) 

YES (12; 60.0%) NO ( 8; 40.0%) 
YES ( 1; 5.0%) NO (19; 95.0%) 



IV. MICHIGAN LIFE ROLE O0MEEHKCIES (MLRC) (Observed in 7 sessions; 

percents in items IV 2-5 are based on these 7). 

1. Tims (in minutes) spent on MLRC: X = 8.2 s.d. = 12.9* 

2. Which of the following instructional materials were used? 

If Yes, what was the title? 

Textbooks and/or workbooks YES ( 4; 57.1%) NO ( 3; 42.9%) 

-"America's Story"(l) 
-"Bill Of Rights"(l) 
-"Protect Our Planet"(l) 
-"Where In The wbrld"(l) 

Filmstrip YES (0; 0.0%) NO (7; 100.0%) 

Wbvie YES ( 0; 0.0%) NO (7; 100.0%) 

Videotape YES (0; 0.0%) NO (7; 100.0%) 

Computer assisted 

instruction YES (0; 0.0%) NO (7; 100.0%) 

Please specify any other materials 
- Globe (2) 



*when classes not scheduled in a three hour block and/or designed for a specific course content 
(e.g., ESL) were excluded, the mean was 11.4 minutes (standard deviation = 13.7); both means 
and standard deviations, by the supervisor's request, exclude time spent watching Channel One. 
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3. Which of the following nodes of instruction were used? 



Modeling (examples given) 


YES 


(o- 


, 0.0%) 


NO 


(7 


, 100.0%) 


Guided practice 














(monitoring) 


YES 


(1 


, 14.3%) 


NO 


(6 


, 85.7%) 


Checking for understanding 


YES 


(4: 


; 57.1%) 


NO 


(3; 


42.9%) 


Drill 


YES 


(0 


; 0.0%) 


NO 


(7' 


i 100.0%) 


Lecture 


YES 


(4; 


57.1%) 


NO 


(3; 


42.9%) 


Problem solving 


YES 


(0 


; 0.0%) 


NO 


(7 


; 100.0%) 


Group discussion 


YES 


(5 


, 71.4%) 


NO 


(2: 


28.6%) 


Review/ follow-up 


YES 


(2 


; 28.6%) 


NO 


(5 


; 71.4%) 


Reading aloud 


YES 


(Is 


; 14.3%) 


NO 


(6: 


85.7%) 


Exercises on chalkboard 


YES 


(0 


; 0.0%) 


NO 


(7 


; 100.0%) 


Please specify any other method 















4. Was the instruction individualized... 

On a one-on-one basis? (1; 14.3%) 

Cri a small group basis? (2; 28.6%) 

Oi both bases (1; 14.3%) 

No individualized instruction seen (3; 42.9%)* 

5. Vtaich of the following were observed during mathematics instruction? 

YES (0; 0.0%) NO (7; 100.0%) 



A preview of the lesson 
A check for students' 
prior knowledge 
Closure on the lesson 



YES (1; 
YES (1; 



14.3%) 
14.3%) 



NO (6; 
NO (6; 



85.7%) 
85.7%) 



6. Garments on the MLRC session: 



*Ihese percents total to 99.9% due to rounding. 
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V. FEEDBACK 



Sometime during the second half hour of class, take a ten minute block of 
time. Within it, obserw the nature and amount of positive and negative 
feedback, (This would include, respectively, positive and negative comments 
in regard to class work or behavior,) 

FEEDBACK 

Pos i t ive Negat ive* 



1. Frequency of feedback? X = 12.0 s.d.= 6.0 X = 0.6 s,d. = 1.1 

2. Appropriate, generally? YES (23; 100.0%) NO ( 0; 0.0%) YES ( 8; 100.0%) NO ( 0; 0.0%) 

3. Effective, generally? YES (23; 100.0%) NO ( 0; 0.0%) YES ( 8; 100.0%) NO ( 0; 0.0%) 

4. Generally followed by 
statements of expected 

behavior? YES ( 8; 100.0%) NO ( 0; 0.0%) 



Please comment: 



VI. DISRUPTIVE BEHAVIOR 



Please describe any instances of disruptive behavior in the class. Minor 
disruptions would include such behaviors as students talking out of turn 
sufficient to distract the lesson. Mkjor disruptions would include 
behaviors which would threaten other students in the class or the teacher, 
or using the teacher's authority. 



DISRUPTIONS** 
MAJOR MINOR 

1. Frequency 0 X = 4.3 s.d. = 3.6 

2. Generally limited to 

a few students? YES ( 0; 0.0%) NO ( 0; 0.0%) YES ( 6; 100.0%) NO ( 0; 0.0%) 

3. Please specify the nature of the disruption(s) and the teacher's reaction(s). 
Include details as needed. 



• T\jo students got up an left the roan, ignoring the teacher's query. 
Teacher pursued them and they returned. 

• There was a great deal of bantering anong the students. 

• Student had someting in his mouth and the teacher made him spit it 
out. 




^Negative feedback occurred in 8 (34.7%) sites. 

**No major disruptions were observed, minor disruptions occurred in only 5 (26.3%) sites; the 
mean and standard deviation are based on those sites. 
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VII. GLASS POHttLTTY 

1« Please describe hew the teacher and students addressed each other in class ♦ 



a. Most often, how did the teacher refer to the students? 
(Circle one) 

FIRST NAME (21; 91.3%)* 

LAST N*ME ( 0; 0.0%) 

LAST NAME WITH TITLE ( 1; 4.3%) 

BOTH FIRST NAME AND LAST NAME WITH TITLE ( 1 ; 4.3%) 
OTHER ( 0; 0.0%) 

- (please specify) 



b. Most often, how did the students refer to the teacher? 
(Circle one) 

FIRST NAME ( 9; 39.1%)* 

LAST NAME ( 0; 0.0%) 

LAST NAME WITH TITLE (13; 56.5%) 

BOTH FIRST NAME AND LAST NAME WITH TITLE ( 1 ; 4.3%) 
OTHER ( 0; 0.0%) 

- (please specify) 

2. Is this formality the way the students prefer the class to be? 

YES (22; 95.7%) 
NO ( 0; 0.0%) 
OTHER ( i; 4.3%) 

- (please specify) not asked 

3. Please describe how guided practice was conducted. 

a. Most often, where was guided practice conducted? 
(Circle one) 

TEACHER'S DESK ( 0; 0.0%) 
STUDENT'S DESK (23; 100.0%) 

b. Most often, who initiated questions about the student's work? 
(Circle one) 

TEACHER (23; 100.0%) 
STUDENT ( 0; 0.0%) 



*Percents sun to 99.9%, rounding. 
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VIII. TESTOC PROCEDURES 

1. Did testing occur during the class time? 

YES -> (Continue Below) (12; 52.2%) 
NO -> (Go to Section IX) (11; 47.8%) 

(Ifote: Percents in VIII 2-10, except for VIII 3 a-c, are based on the 12 sites wherein testing 
was observed* 

2. Were instructions given orally prior to the test being distributed? 

YES (6; 50.0%) 
NO (6; 50.0%) 

3. Did all of the students take the test? 

YES -> (Go to Question 4) (4; 33.3%) 
NO -> (Continue Below) (8; 66.7%) 

(Note: Percents in VIII 3 a-c are based on the eight sites where not all student took the test.) 

a. Were the students physically grouped or regrouped 
into test takers and non-test takers? 

YES (3; 37.5%) 
NO (5; 62.5%) 

b. Did talking anong the non-test takers occur during 
the test? 

YES (3; 37.5%) 
NO (5; 62.5%) 

If Yes, how did the teacher 

react? 

- Politely asked the student not to talk (1) 

- Joined in the discussion (1) 

- No reaction (1) 

c. Specify vhat those not taking the test were doing. 

- Workbook activities (8) 

4. Were all of the books and papers put away before the test began? 

YES (11; 91.7%) 
NO ( 1 ; 8.3%) 



ERLC 



31 



APPENDIX B 



5. Was blank paper and/or the test instrument distributed by the teacher? 

YES (9; 75.0%) 
NO ( 3; 25.0%) 

If tfo, hew were they distributed? 

- By an aide (3) 

6. Did talking among the test takers occur during the test? 

YES ( 5; 41.7%) 
NO (7; 58.3%) 

If Yes, how did the teacher react? 

- Gave the students instructions to remain 
silent during the test (5) 

7. V&io corrected the tests ? 



The teacher 


(10; 


83.3%) 


The teacher's aide 


( 2; 


16.7%) 


The student who took the test 


( 0; 


0.0%) 


Another test taker 


( 0; 


0.0%) 


A student who did not 






take the test 


( 0; 


0.0%) 



8. Were the test papers or answer sheets collected? 

YES (12; 100.0%) 
NO ( 0; 0.0%) 

If Yes, were they collected by... 

The teacher? ( 9; 75.0%) 

A teacher's aide? ( 3; 25.0%) 

A teacher-designated student? ( 0; 0.0%) 

Other (specify) 

If No, describe what was done with 

the tests and how the grades were 
recorded? 

9. Did the teacher offer any inappropriate assistance to the test takers? 

YES (10; 8.3%) 
NO ( 6; 91.7%) 

If Yes, please specify. 
- Coaching by aide (1) 



ERIC 



32 ° ' 



APPENDIX B 



10. Specify the type of test (e.g., spelling). 

- Mathematics (6)* 

- Spelling (5) 

- language arts (5) 

- Self Concept (an MLRC objective; i) 



DC GEIER COMENTS 

Please comment on anything salient you observed occurring in this class 
which was not addressed by the above questions. 

• In three (13.0%) cases, the anount of instructional 
time was limited by external constraints - assemblies 
(2; 8.7%) and institutional reasons (1; 4.3%). In 
one case (4.3%), the teacher focused on an extraneous 
topic for a substantial portion of the class (65 
minutes; 39.4% of the available instructional time). 

• In one class (4.3%) erronous material was presented 
and in one other (4.3%) class discussion wandered 
from curricular to colloquial topics. 

• In two instances (8.7%), good interaction between 
the teacher and the students (in a curricular 
context) was noted. 

• Three teachers (13*0%) explained to the evaluator 
why MLRC instruction was not in evidence on the day 
of the observation. Students had completed the 
lessons in those MLRC materials which the teachers 
had thus far received; they were awaiting the new 
MLRC materials. 



TOTAL CLASS TIME** 

- Scheduled: X = 160.2 s.d. 10.5 

- Elapsed: X = 144.0 s.d. = 10.5 



*Some students took more than one test. 

^Scheduled class time varied due to constraints which were specific to the host buildings; 
elapsed time, by the progran supervisor's request, does not include any time spent viewing 
Channel One. 
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TABLE C.l. AMOUNT OF INSTRUCTION OFFERED IN STANDARD ABE CLASSROOMS* 
(N=17), BY INSTRUCTIONAL TOPIC, 1991-92. 



Instructional Time 
Topic In Minutes** 

Mean Standard Deviation 



Reading 93.5 23.3 

Mathematics 34.5 12.3 

MLRC 11.1 13.9 



^Standard ABE classrooms were those designed to offer 
reading mathematics and MLRC instruction in a three hour 
block. Classes where the focus is more directed on one 
of these topics (i.e., ESL or bilingual) or where the 
class length is different (i.e., teen mothers, senior 
citizens, handicapped) were excluded from this table. 

fc*Classtime spent viewing Channel One was excluded from these 
calculations as per the request of the program supervisor. 
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